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1. Introduction 

By one of the main results in renewal theory, it is known that the age of a 
renewal process has a limiting distribution, given that its steps have finite mean. 
When the steps are iid and regularly varying with infinite mean, the limiting 
distribution is determined by the Dynkin-Lamperti theorem. In this article, we 
aim to understand the limiting behavior of the whole path of such a renewal 
process before a given time t. Moreover, we do that under milder conditions, 
that is, we keep the regular variation assumption, but allow certain degree of 
dependence between the steps of the renewal process. More precisely, we assume 
that the steps form a stationary sequence (V„) of nonnegative random variables 
which are regularly varying with index a G (0,1). By one characterization of 
regular variation, see Resnick [16], this means that there exists a sequence of 
nonnegative real numbers {dn) such that 

nP{Y €dn ■) At( • )) (1-1) 

as n —>■ oo, where denotes vague convergence of measures on (0, oo) and the 
limiting measure satisfies oo) = for all a; > 0. 

It will be useful in the sequel to extend (dn) to a function on [0, oo) by 
denoting d(t) = dpj, for t > 0, with dg = 1. It is known that d has an asymptotic 
inverse, d say, see Seneta [18], in the sense that 

d(d(t)) ^ d(d(t)) ^ t , 


1 


( 1 . 2 ) 
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as t ^ oo. One can show that d is a regularly varying function with index a. 
Denote by 


r(t) = infjfc : Yi + ■ ■ ■ + Yk > t} , for t > 0 , (1.3) 

the first passage time of the level t by the random walk with steps (Yn). Our 
main goal is to describe the asymptotics of all the steps in the renewal process 
before the passage time T(t), i.e. of the random variables 

y, i = 1,... ,T(t) - 1, (1.4) 

including the age of the renewal process at the passage time, that is 

AW = ^ ~ . (1.5) 

For iid steps (F„), the proof of the following classical theorem can be found in 
Bingham et al. [5]. 

Theorem 1.1. (Dynkin-Lamperti) Suppose that (F„) is iid sequence of random 
variables, then (Yn) satisfies (1.1) with the tail index a G (0,1) if and only if 

as t ^ oo, where the random variable on the right hand side has a generalized 
arcsine distribution with the density 

9a(w) = (1 — u)““^, ue[0,l]. (1.6) 

TT 

It turns out that the necessity part of this theorem holds for certain dependent 
renewal processes too. More importantly, in all such cases one can describe the 
joint asymptotic behavior of the random variables in (1.4) and (1.5), and show 
that they, when ordered, form a sequence which converges towards the so-called 
Pitman-Yor distribution. As far as we know, this result is new even in the iid 
case. 

The paper is organized as follows: in Section 2 we consider Pitman-Yor distri¬ 
bution on the interval partitions from the perspective of point processes theory. 
We further present two limiting theorems about stationary strongly mixing se¬ 
quences (Yn) satisfying (1.1) which are likely to be of independent interest. 
These theorems are used in Section 3 to determine the asymptotic distribution 
of the steps Yi/t , i = 1,..., r(t) — 1 and the age of the renewal process . We 
also exhibit how this result extends the classical Dynkin-Lamperti theorem and 
discuss corresponding assumptions. It immediately yields the joint asymptotic 
distribution for the ranked lengths of excursions in a simple symmetric ran¬ 
dom walk, cf. Csaki and Hu [6]. More technical proofs and results concerning 
Skorohod’s topology and convergence of point measures are postponed to the 
Appendix. 
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2. Point processes and Pitman-Yor distribution 


In a remarkable series of papers: [14], [13], [12]; Perman, Pitman and Yor de¬ 
scribe the distribution of jumps of stable subordinators on a given time interval. 
In particular. Pitman and Yor in [14], use such jumps to introduce a new family 
of distributions on interval partitions and relate them to the classical arcsine 
laws for Brownian motion. Recall that a stable subordinator {S{t))t>o is a Levy 
process with the Laplace transform given by the formula 


Ee 




= exp 


—t (l — p!{dx) 

Jo 


with the Levy measure 

p!{dx) = CctX~°‘~^dx , 

for some a G (0,1) and a constant Cq > 0 which turns out to be unimportant 
in the sequel. So without loss of generality we typically assume Ca = 1, i.e. 
pd = p. The subordinator {S{t)) has the distribution of the inverse local times 
of d-dimensional Bessel process, for d = 2(1 — a), with the case a = 1/2 
corresponding to the Brownian motion. In other words, jumps of the process 
{S{t)) correspond to the lengths of excursions of the Brownian motion or, more 
generally Bessel process, away form the origin. By Ito’s representation {S{t)) 
can be constructed from a Poisson process N on the space [0, oo) x (0, oo] with 
intensity measure equal to Leb x p', so that 


N = ^ 5Ti,Pi and S{t) = ^ Pi, for t € [0, oo). 

i Ti<t 


( 2 . 1 ) 


We alternatively say that iV is a Poisson random measure and denote this by 
N ^ PRM(Leb x p'). By the construction, {S{t)) is a nondecreasing element 
of the space of cadlag functions I?[0,oo). Denote by z'^ the right continuous 
generalized inverse of a function z G D[0, oo), i.e. 

z‘^{u) = inf{s G [0, oo) : z{s) > m} , m > 0 . 

The generalized inverse of the process S{t) is the process 

L{s) = S"*“(s) = inf{t : S{t) > s} , s > 0. 


It is well defined and continuous at any s > 0, and for the reasons explained 
above it is called local time process by Bertoin in [3]. If we denote by Z the 
closure of the range of the process {S{t)), the maximal open subintervals in the 
set n (0, s), s > 0, correspond to the jumps of the subordinator before it 
crosses over level s. Their lengths are {S{t) — S{t —)), t < L{s), which are equal 
to 

Pi, Ti < L{s), 

above, together with the last incomplete jump which has the length 

= s ~ Pi ) 

Ti<L(s) 


( 2 . 2 ) 
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see Bertoin [3]. Considering these points in descending order we arrive at the 
sequence 

V(s) = (Fi(s)V2(s)V3(s),...) . 

Observe that the distribution of V{s) corresponds to the distribution of the 
point process 

^Vi(s) = ^ Sp. . 

t Ti<L(s) 

Clearly, normalizing the infinite sequence V(s) by s > 0 produces a random 
sequence which sums up to one. An extraordinary observation of Pitman and 
Yor [14] was that 


V(s) d V{S{t)) 
s S{t) 


for all s,t G (0, oo). 


(2.3) 


This is surprising, since the sequence on the right hand side is produced by 
ordering and scaling the points 


P T- < f 

and therefore has no special ’’last interval” as in (2.2). Due to the identity (2.3), 
it suffices to describe the distribution of y(l), thus we denote 

y(l) = (yi(l), ^2(1), ^3(1), ...)=: {Di,D2, Da,...) . 

The distribution of this sequence corresponds to the distribution of the point 
process 

OO 

= '^5d,. 

i=l 

It turns out to be easier to describe the distribution of the size-biased permu¬ 
tation of the sequence y(l), say 

(C/i,[/2,D3,...) , 


although clearly 

i i 

Perman [11] proved that 


2-1 

1=1 

for a sequence of independent random variables = 1,2,3,..., such that 
^ ^ Beta(l — a,ia). We call the distribution of the sequence V'(l), or equiva¬ 
lently of the point process the Pitman-Yor distribution with parameter 

a. This distribution has further natural extension to two parameter family of 
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distributions on the interval partitions, see Pitman and Yor [15]. That family 
found important applications in nonparametric Bayesian statistics, e.g. see Teh 
and Jordan [19] and references therein. Moreover, the arcsine laws for the frac¬ 
tion of time Brownian motion spends in the upper halfplane at a fixed time t or 
at inverse local time L{s), can be seen as corollaries of the results in [14]. 

In the course of showing (2.3), Pitman and Yor showed that Ui above ac¬ 
tually has the distribution of the final interval length Ai from (2.2). This 
distribution is the same as the generalized arcsine distribution of the ran¬ 
dom variable A in theorem 1.1. These results allowed Perman [12] to describe 
the density of sup{Pi : Ti < T(l)}, which corresponds to the longest ex¬ 
cursion of the d-dimensional Bessel process completed by the time 1, and of 
Di = max{sup{Pi : Ti < L(l)}, Ai}, which has the same interpretation but 
includes the last a.s. incomplete excursion. 

It is well known that iid sequence (Y„) satisfies (1.1), if and only if the 
following convergence of point processes holds 



(2.4) 


where N denotes a Poisson process on the space [0, oo) x (0, oo] with intensity 
measure Leb x fi, see Resnick [16]. The convergence of point processes in (2.4) 
and throughout is to be understood with respect to the vague topology on the 
space of Radon point measures on [0, oo) x (0, oo), denoted by Mp = Mp{[0, oo) x 


(0,oo]). 


If (1.1) and (2.4) hold for a general stationary sequence (Yn), then it neces¬ 
sarily has the extremal index equal to 1, see Leadbetter et al. [9] for instance. In 
other words, the partial maxima in the sequence (Y„) behave as if the sequence 
was iid, i.e. M„ = max{Yi,..., Y„} satisfies as n —>• oo where 

denotes the standard Frechet distribution, i.e. d>o,(a;) = exp(—x““), a; > 0. Next 
theorem, proved in the Appendix, claims that the opposite is also true. Namely, 
strongly mixing sequences which satisfy (1.1) and have extremal index equal to 
1, necessarily satisfy (2.4). Observe that the theorem holds for all a > 0, and 
not merely on the interval (0,1) which is of our main interest in this paper. 

Theorem 2.1. Suppose that (Yn) is a stationary strongly mixing seguence of 
nonnegative regularly varying random variables with tail index a > 0. Then 


d 


as t ^ oo, where N is PRM(Leb x /i) if and only if (Y„) has extremal index 
equal to 1. 

For iid steps, (2.4) and the continuous mapping theorem imply 



Ld(t)-J 


(2.5) 
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in D[0,oo) with respect to Skorohod’s Ji metric, see Resnick [17], Chapter 7, 
cf. theorem 2.2 below. Moreover, for a € (0,1) 


S(t) = ^ P. 

Ti<t 


' [0,t] X {0,oo] 


yN{dt,dy) 


has finite value with probability 1 for alH > 0. Observe that 


Sni) = inf 


Ld(t)sJ 

s : ^ Yi > t 

i=l 


inf e N : X;J=i h* > _ r{t) 

d{t) d{t) 


Denote = 5'j^(l) = T{t)/d{t) and recall L{u) = S^{u) = inf{t : S{t) > u}. 
For simplicity denote L = L{1). By an application of the continuous mapping 
argument, from (2.5) one can also show 


LW = ^ = 5r(l) A5-(1)=L. 
d{t) 

In the following theorem we show that this convergence is joint with the con¬ 
vergence in (2.5), whenever (2.4) holds. 

Theorem 2.2. Suppose that (Yn) is a stationary strongly mixing sequence of 
nonnegative regularly varying random variables with extremal index equal to one 
and the tail index a G (0,1). Then, as < —> oo 


(7Vt,5i,L(‘))P4(7V,5,L), 


( 2 . 6 ) 


in the product space Mp x ll[0,oo) x R and the corresponding product topology 
(of vague, Ji and Euclidean topologies). 


Proof. By theorem 2.1 


N, 


N. 


as t —>■ oo. We will first prove the convergence of the other two components 
in (2.6) by an application of the continuous mapping argument. Since all the 
components are obtained by a transformation of the point process Nt, one can 
easily see that the convergence is joint. 

The proof of St —> S in Ji topology is standard. One could first observe 
that the functional : Mp —>■ D[0,t], given by 


’ ('®) ^ ^ ^i^{xi>e} ) 

ti<S 


for TO = ^ and s G [0, t], 

i 


is a.s. continuous with respect to the distribution of the limiting point process 
N and chosen topologies. Then one can simply follow the lines of the proof of 
Theorem 7.1 in Resnick [17], and finally apply lemma 16.3 in Billingsley [4] to 
extend the convergence from D[0,f\ to I1[0, ooj. 
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By the continuous mapping argument, see Lemma 4.1 in the Appendix, it 
follows that 

lW = 5^(1) A S'^(l) = L. 


□ 


The random variable L in (2.6) represents the first passage time of the level 
one by the a-stable subordinator S. Its distribution is known in the literature 
as a Mittag-Lefller distribution. 


3. Main theorem 


Our main result extends the sufficiency part of the Dynkin-Lamperti theorem 
in a couple of ways. We first show that one can describe the limiting distribution 
of not merely the age of the renewal process at time t, but also the behavior of 
all other large steps before that time. By doing that, we obtain the Pitman-Yor 
distribution as the limiting distribution for the steps after appropriate normal¬ 
ization. We also show that the statement of Dynkin-Lamperti theorem about 
iid regularly varying random variables can be generalized to cover all regularly 
varying sequences with non-clustering extremes considered in the previous sec¬ 
tion. For simplicity, denote 

=1-St 

and A = Ai = 1 — S (L—). 

Theorem 3.1. Suppose that (Y„) is a stationary strongly mixing sequence of 
nonnegative regularly varying random variables with extremal index equal to one 
and the tail index a G (0,1). Then, as t ^ oo, 

+ E ^ ’ ( 3 . 1 ) 

i<T{t) 

where represents a Pitman-Yor point process with parameter a. Moreover, 

the convergence above is joint with 

a a , 

as t ^ oo, where A has the generalized arcsine distribution given in (1.6). 

For a measure iz ona measurable space (S, S), by z/|b we denote the restriction 
of the measure iz on the set S G 5 given by i/|b(C') = iz(BnC), C G S. Abusing 
this notation somewhat, for any time period A C [0, oo) and an arbitrary point 
measure n G A'/p([0, oo) x (0, oo]), we write 


n 


for n 


A 


Ax (0,oo] 


(3.2) 
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Proof. By theorem 2.2, (Nt, St) (N, S) in the appropriate product topology, 
as t —)> oo. Moreover, the limit {N, S) a.s. satisfies the regularity assumption of 
lemma 4.1 and theorem 4.1 below. Therefore, this convergence is joint with the 
convergence in 

A . 

By theorem 4.1, as t —>■ oo, 

^‘l[0.L(‘))= ^^l[0,L)= kPPi)- 

i<T(t) ^ Ti<L 

In particular for / £ oo]), where denotes the family of nonnegative 

continuous functions with compact support 


E 

exp 1 - E [ 

^ E 

exp 

- E /(^^)| 


[ i<r(i) J 


1 

Ti<L ) . 


as t —>■ oo. Since the corresponding Laplace functionals converge, we conclude 
that 

i<T{t) Ti<L 

Because, this holds jointly with A^*'' A. We conclude that 

<5^(0 + E ^Sa+J2^p^ = • 


Remark 3.1. The strong mixing assumption in the theorem is actually unnec¬ 
essarily strong, one could alternatively consider any stationary sequence (¥„) 
which satisfies (2.4). In the extreme value theory it is known that this holds 
under milder conditions cf. Basrak et al. [1]. 

Remark 3.2. An interesting implication of theorem 3.1 concerns the lengths 
of excursions of the simple symmetric random walk during the first n steps. 
They are known to be independent and regularly varying with index a = 1/2. 
Therefore, theorem can he applied to deduce and extend results in Csdki and 
Hu [6] about the asymptotic distribution of these excursions. 

The value in theorem 3.1 is called the undershoot or the age of the 
renewal process at time t. Similarly, one could define the overshoot at t as 

= St - 1 = —- . 

Recall that represents the scaled first passage time. Straightforward appli¬ 
cation of theorem 2.2 and lemma 4.1 yields the following corollary which should 
be compared with Dynkin-Lamperti theorem, cf. theorem 8.6.3 of Bingham et 
al. [5]. Note however that the corollary admits weak dependence between the 
steps of the renewal process. 
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Corollary 3.1. Under the assumptions of theorem 3.1, the convergence in (3.1) 
is joint with 

a {A,B,L) , 

as t —>■ oo. Moreover, the joint density of the random vector {A, B) is given 
in Bingham et al. [5] theorem 8.6.3, while the random variable L has the same 
distribution as in theorem 2.2. 


4. Appendix 


Proof, (of theorem 2.1) As we explained before the theorem, it remains to show 
sufficiency. Assume that (Yn) is strongly mixing with the extremal index equal 
to 1. 

Denote by a{n) the mixing coefficients of the sequence (Vn). Then set In = 
[max{l, , clearly In = o(n), In —>■ cjo. Introduce also the sequence = 

[max{l,«(?„),, and observe rn —>• oo. By proposition 1.34 in Kriz- 
manic [8], the sequence (r„) satisfies the following condition: for every / S 
C^([0,oo) X (0,oo)) 


E 




n E 

/c=l 


exp 


-E/(—-C'r. 

2=1 


(4.1) 

as n —>■ 00 , assuming without loss of generality that the support of / lies in 
[0, L] X [l,oo\ for L,l > 0. In other words, the strong mixing condition implies 
the condition A'(on) introduced in Basrak et al. [1]. 

Observe that 


lim (P(r < dnufr 

n—¥oc> 


lim 


/ nP(Y > dnu) 
\ n 


= e-“ >0, 


(4.2) 


for any m > 0. Note that the sequences {In) and (r^) satisfy = o(n) na{ln) = 
o(rn), In = o{rn). According to O’Brien [10], the extremal index 9 of the se¬ 
quence {Yn) satisfies 


9 = lim P{Mn^ < dnU \ Fg > dnU) 

n—^oo 


for any fixed u > 0. Since, by assumption, 0 = 1, we obtain 


P{Mn^ > dnU I Fg > dnU) = P[ max Yi > dnU 


Fg > dnU 


0 , 


as n ^ OO. Hence, by stationarity, for every u > 0, 

lim sup PI max F > dnU Fg > dnU ) = 0. 

n-yco 


(4.3) 


Consequently (F„) is jointly regularly varying in the sense of Basrak and Segers [2] . 
Moreover, its tail sequence is trivial. 
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We observe next that by (4.1) and (4.3), the point processes 

(4.4) 

i>l " ” 

in Mp satisfy the assumptions of Theorem 2.3 in [1], adjusting the state space 
from [0,1] X (0,oo] used there, to the case [0,L] x (0,oo] we need here. This 
means, in particular, that for all L > 0, u > 0 




[0,L] X (u,oo] 


Ar(“) = S,. 




[0,L] X (ii,oo] 


as n —>■ oo, where 






is a homogeneous Poisson process on [0, oo) x (1, oo] with intensity M““Leb x /I, 
where Jl denotes the probability measure obtained by restricting measure ^ to 
the interval (1, oo]. However, if we denote by dTi,Zi a Poisson process 

on [0, oo) X (0, oo] with intensity Leb x fi, then for for all L > 0, it > 0 


7V(“) £ N 


[0,L] X (u,oo] 


In particular. 

Consider the mapping from Mp x (0,oo)^ to Mp, given by 

(to, a, b) 1 -^ to“’^, 


(4.5) 


where 


m“’^(/ x J) = m{I/a x J/b ), 


for all measurable sets /, J. Vague convergence theory as presented in section 
3.4 of Resnick [16], shows that this mapping is continuous. This turns to be 
useful, since 

(^ dm) \ 

\ d(t) t J 


Nt{I,J) = N. 


im\ 


Observe that 


N, 


Kt)j 


JV and 

V ‘ ) 


as t — 5> OO. Hence, by (4.6) and (1.2), one can conclude 

d 


Nt 


N. 


(4.6) 


as t —5> oo as well. 


□ 
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Denote by n, rij, t > 0, arbitrary Radon point measures in Mp([0, oo) x (0, oo]. 
One can always write 


nt 




n — 


i 


for some sequences (u|), (y*), (vi) and (y^) of positive real numbers. Denote fur¬ 
ther the corresponding cumulative sum functions of the point measures n, nj, t > 
0,by 

st(u) = / ynt{dv,dy), u>0, 

J [0,ii] X ( 0 , 00 ) 


and 


s(m) = f 


[0,u] X (0,oo) 


yn{dv, dy) , m > 0 , 


Assume that these values are finite for each u > 0, but tend to 00 as m —)> 00 . 
This makes St and s well defined, unbounded, nondecreasing elements of the 
space of cadlag functions D[0,oo). Their right continuous generalized inverses 
(or hitting time functions) we denote by s'*” and s)”, recall that s'*”(w) = inf{u G 
[0, 00 ) : s(r!) > u} , u>0. We will use the following abbreviations in the sequel 


Tt = s^ (1) and r = s'*”(l). 


It is well known that Ji convergence 


St 




S, 


in general does not imply convergence of St towards s at a given point. However, 
the following technical lemma shows that under some regularity conditions, it 
implies the convergence of both st and its left limit at the first passage time 
Tt. It is a consequence of Theorem 13.6.4 in Whitt [20] which has a weaker 
assumption that st converge towards s in M 2 topology. 

Lemma 4.1. Assume that 

St s, (4.7) 

and suppose that s{v) < 1 for each v < t. Then 

( tj , St(Tt-), stin)) (r, s ( t -), s(r)). (4.8) 


Theorem 4.1. Assume that 


{nt,st) ^ {n,s), (4.9) 

in the product topology (of vague and Ji topologies) as t ^ 00 . Assume further 
that 0 < s(t— ) < 1 < s(t) and n({w} x (0, 00 )) < 1 for all v > 0. Then 
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Proof. By the definition of the vague convergence, it is enough to show the 
convergence in the state space [0, oo) x (u, oo] for some number u > 0 in the 
arbitrary neighborhood of 0. Because n is a Radon measure, one can always 
find u > 0 which is arbitrarily close to 0 and satisfies n.([0, oo) x {rt}) = 0 and 
u < s(t) — s(t—). Since s is a cadlag function, there exists Eq > 0, such that 

s(t + eo) - 5 ( 1 ") < u/3 • (4-11) 

Since St and s are monotone functions, by theorem 2.15 a) in Jacod and 
Shiryayev [7], chapter VI, (4.9) implies that there exists a dense set of points 
G C [0, 00) such that St{d) —>■ s{d) for each d G G. Take 0 < e < Eoj such that 
T + e G G, n({r + e} x (0, 00)) = 0, and such that 

k 

^1 [0,r] X (u,oo) ^1 [0,r+e] X (it,oo) ^ ^ (4-12) 

i=l 

By Proposition 3.13 in Resnick [16], there exists a constant Iq, such that for all 
t>to 

i=l 

and 

(vpyl) ^ ivj,yj), j = l,...,k, (4.13) 

as t —>• oo. Since t* —>• r by lemma 4.1, there also exist tp, such that for all t > 


Tt <T + e. 


For t > tg V tg 

I [0,r+e] X (ii,oo) I [0,rt] X (ii,oo) 4” | ,T+e] x (ii,oo) ' (4-14) 

But we will show that the second point process on the right hand side above 
equals zero for all t large enough. 

Because St{T + £)—>■ s(t + e), St{Tt) —t s(r), by (4.11) there exists tg" such 
that for t > tg" 

2 

St{T + e) - stin) < -u. (4-15) 

Now for t > tg V tg V tg" 

nt{{Tt,T+ e] X {u,oo)) = ^ hyl>u} (4-16) 

’'*e(T't.T+e] 

- XI ylhvt>u} < ^ (stir + e) - st(Tt)) < I. (4.17) 

u u o 

vlEpt.T+e] 


Since rit is a point measure, rit ((r^, r + e] x (u, oo)) = 0 for all t large enough. 
So, by Proposition 3.13 in [16] 


nt 


[0.1-t] 


l[0.r] 


(4.18) 
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Suppose that the rightmost point of the point measure on the right hand side 
above has the coordinates 

(r, j) where j = s(r) — s(r—) > 0 , 

because n({r} x (0,oo)) < 1 Then, by (4.13) there exist points {crt,jt) of the 
point measures on the left hand side of (4.18) such that 

(fLtJt) (r, j) = (r,s(T) - s(t-)) . 

By the assumption, there exists e > 0 such that s(r) > 1 + e. Note that there 
also exists d G G, d < t such that 

s(t-) - I < s{d). 

For all sufficiently large t now at > d, and 

S S 3 

St(crt) > St{d) + jt > s{d) - 4 + J - 4 > + J - 4^ > 1 ■ 

Therefore at = Tt for all sufficiently large t. Recall that we fixed a constant 
u > 0 such that n([0, oo) x {u}) — 0. Then for all large enough t 

I [0,rt) X (?i,oo] I [0,Tt] X (?i,oo] • 

Thus (4.18) together with {Tt,jt) implies 

I [0,Tt) X (-UjOo] I [0,rt] X (-UjOo] ^ntjt ^ ^ I [0,t] X (u,c»] ^ I [0,r) X (u,c»] ’ 

as t —>■ OO. 
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